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<d ' Abstract 
O 

This Letter proposes a controlled coupling process for information processing. 
Q ' The net effect of conventional coupling is isolated from the dynamical system 

u' 

^ I and is analyzed in depth. The stability of the process is studied. We show that 

the proposed process can locally minimize the smoothness and the fidelity of 

dynamical data. A digital filter expression of the controlled coupling process 

\^ ' is derived and the connection is made to the Hanning filter. The utility and 
(N ' 

O ' robustness of proposed approach is demonstrated by both the restoration 

' of the contaminated solution of the nonlinear Schrodinger equation and the 

estimation of the trend of a time series. 

; PACS numbers: 05.45. Gg, 05.45.Tp, 05.45.Xt 

> 

^ , The topic of synchronization and chaos control has attracted much attention in the past 

H : 

^ decade Active research in this area has contributed greatly to the understanding of 



a wide class of complex phenomena, including synchronization in secure communication , 
electronic circuits [Q, and nonlinear optics [Q, coherence transfer in magnetic resonance 
and oscillation in chemical and biological systems 0. In fact, the study of this topic 
leads to many practical applications in the aforementioned fields and a realistic scheme for 
shock capturing [j^ in fluid dynamics. An interesting signal processing scheme was pro- 
posed by Lindner et. al. |^ in the context of synchronization. It is beneficial to explore 
further the potential of synchronization and chaos control techniques to digital signal pro- 
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cessing (DSP) and information autoregression (lAR). Both DSP and lAR are of crucial 
importance to telecommunication, biomedical imaging, seismic, radar, pattern recognition, 
missile guidance, target tracking, autonomous control, and a wide variety of other signals 
and data processing for commerce, finance, defense and scientific interests. Despite of the 
great achievements of traditional DSP and lAR techniques, many real-world problems re- 
main unsolved due to the nonlinearities, non-Gaussian noises and limited real-time working 
conditions often encountered in applications. Solving these complex problems would require 
the development of innovative, flexible, fast, nonlinear DSP and lAR algorithms. The ob- 
jectives of this Letter is to develop a synchronization-based, realistic technique for DSP and 
lAR. 

We consider a nonlinear dynamical system consisting of identical subsystems, which 
are coupled via the nearest and next-to-the-nearest neighborhood sites 

^ = f{u,) + N,{t) 

+ a(Mj+2 - ""i+i) + {b- 3a){uj+i - Uj) 

+ a{uj_2 - Uj^i) + (6 - 3a){uj^i - Uj), (1) 

where Uj G [0, oo) xi?", / is a nonlinear function of uj which might undergo chaotic dynamics, 
Nj{t) is the noise, a and b are scalar hyper-diffusive and diffusive coupling parameters, 
respectively. Equation (|l|) is a generalization of that given by Lindner et. al. p|. The 
coupling scheme in Eq. (|l]) is strongly dissipative and a synchronous state can be attained 
for the chaotic Duffing oscillators, ii = [x, y) = [y, —0.3y—x'^ + ll cost), by using appropriate 
coupling parameters . It is important to analyze in depth the effect of the coupling in Eq. 
(H). To this end, we introduce the following controlled couphng process 

^ = Ot,,t,,...,,{t) [f{u,) + NM 

+ ^ti,t2,-,tfc W [0'{uj+2 - Uj+i) + (6 - 3a){uj+i - Uj) 

+ a{uj-2 - Uj-i) + {b- 3a){uj-i - uj)] , (2) 

where ^ii.ta, (0 is a control function which consists of a train of Heaviside type intervals 
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and dti,t2,---,tkit) is the complement of Ot^^t2,--,tkif) in the domain [0, oo) [i.e., Ot^^t2,--,tkif) = 
1 — ^ti,t2, (^)]- Both control functions are depicted in FIG. |1]. During the time interval 
< t < ti, each subsystem, including possible noise, evolves freely. At time ti, the coupling 
is switched on and the time evolution of the system is entirely governed by the controlled 
coupling until t2- The subsystems return to the state of free evolution in the next time 
interval. 

The controlled coupling process, Eq. (||), allows a detailed analysis of the net effect of 
the coupling in Eq. At time ti < t < ^2, a discrete form of Eq. @) can be given by 

+ T(^/f_2 - Au'._, + 6«f - Au'._^, + , (3) 
u] = u,{ti) j = l,...,N, 

where R = bAt, T = aAt and iteration parameter 5' are user-specified constants. The con- 
trolled coupling process (|^) is conditionally stable. Neglecting the boundary modifications, 
we can rewrite Eq. (|^) in a matrix form, 

t/^+i = AU^, (4) 

where = {uf, ttf , . . . , uf^)^, and the banded matrix A has nonzero coefficients: cLjj-2 = 
= T, ttjj^i = ctjj+i = i? — 4T, and ajj = 1 — 2R + 6T, for j = 1,2, . . . , N. If all of the 
eigenvalues of A are smaller than unity, the iterative correction e^^^ = \\U^'^^ — U^\\ will 
decay, then the process is stable. Since each diagonal term of the matrix is a constant, the 
eigenvectors of A can be represented in terms of a complex exponential form, 

where i = ^/—l and 7 is a wavenumber that can be chosen arbitrarily. Substituting Eq. 
into Eq. (^) and removing the common term e'^^f we obtain an explicit expression for the 
eigenvalue q: 

q = l + 2T(2cos2 7-cos7-l) + 2(i?-3T)(cos7-l). (6) 
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For a stable process, the magnitude of this quantity is required to be smaller than unity, 

< 1. (7) 

For the case of T = 0, g is the maximum when cos 7 = —1. Thus, the controlled coupling 
process is stable provided < < |. On the other hand, if i? = 0, our analysis indicates 
that > T > — ^7 — 2 — h TTT, which also takes an extremum at cos 7 = — 1. Therefore, 

2 (cos^ 7— 2 cos 7+1) ' ' ' 

the controlled coupling process is stable provided > T > — |. Under these conditions, we 
have e'^^"'^ < e*^, for any 5" G Z^. 

It is interesting to noted that the controlled coupling process, Eq. (0), provides not 
only a treatment of nonlinear dynamical systems, but also a powerful, realistic approach to 
DSP and lAR of real-world problems. For lAR, Whittaker [|10| suggested a method of trend 
estimation by the global minimization of fidelity and smoothness. The latter is defined 
by the accumulated power of the finite difference. Hodrick and Prescott [|lT| provided a 



concrete version of Whittaker's approach. Recently, Mosheiov and Raveh |T2| proposed a 
linear programming approach to estimate the trend by employing the sum of the absolute 
values rather than the common sum of squares to measure the smoothness and fidelity. In 
the present approach, the terms in the first and second brackets of Eq. (j^) are the second 
order and fourth order pointwise measures of smoothness, which are denoted as A^w^ and 
A^uJ, respectively. To have a better understanding of this controlled coupling process, we 
rewrite Eq. as 

h(ti)-tif] + [/?^f~^ + r«;f-i] = 0, j = l,...,iV, (8) 

where v^~^ = J2k=o ^^""j 5 Wj~^ = ^f^g A^u^. It is clear that the expression in 
the first square bracket is the local measure of the fidelity, while the expression in the 
second square bracket is the accumulative local measures of smoothness. Due to e'^"'"^ = 
||f/s+i - f/^ll = ||i?A2f/^ + TA^U^W, is actually a global smoothness measure of estimated 
trend at the S'th iteration. One can argue that as the iterative process is carried out 
for a longer time, the estimated trend becomes smoother, while the deviation of U''^ from 



— U{ti) — [ui{ti) , U2{ti) , . . . , UN{ti)\^ becomes larger. At each step of the iteration, this 
process guarantees that the sum of the local deviation from Uj{ti) and the accumulative 
local measure of smoothness equals to zero. As such, the result of each iteration is optimal 
in the sense of minimization, for the given input and the set of parameters R and T. Two 
smoothing parameters R and T, and the iteration parameter S, govern the fundamental 
tradeoff between the smoothness and fidelity. In practice, R and/or T can be pre-fixed and 
only the iteration parameter S is optimized to achieve desired results. In comparison, the 
previous lAR methods seek for global minimizations over the entire domain to obtain optimal 
estimates, while the present controlled coupling process forces the sum of smoothness and 
fidelity to pass through zero at each iteration to give an optimal trend. The advantage of 
the proposed controlled coupling is its simplicity, robustness and efficiency. 

For DSP, it is important to analyze the relationship between the proposed process and 
digital filters. To this end, we explore a weighted average representation of the controlled 
couphng process. For simphcity, we consider the case of T = 0. We first set 5* to 1, then 
the controlled coupling process gives 



which is clearly a local weighted average form for Uj{ti). In general, after S iterations, the 
controlled coupling process can be represented as: 

j+s 

E Wik,S)ukih), (10) 

k=j-S 

where weight function W{k, S) has the general form of 



u] = Ruj-i{ti) + (1 - 2R)uj{ti) + Ruj+iih), J = 1, . . . , 



(9) 




1) when S 



when S 



k even 



k odd. 



(11) 



and 



g{K s, h) 




(12) 
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It can be easily verified that, 



j+s 

J2 W{k,S) = l, (13) 



k=j-S 

and 

W{-k,S) = W{k,S) yk = l,...,S. (14) 

Equation (|T0|) indicates that the controlled coupling process can be viewed as a kernel 
smoother for lAR and a low-pass filter for DSP. The implementation of the controlled cou- 
pling process becomes extremely simple due to the existence of Eq. ([10|) . Therefore, the 
weighted average form (0) is numerically very useful. The weights assignment of the con- 
trolled coupling process filter is analogous to that of other kernel regression methods. For 
a reasonable choice of R and S, the greater or smaller weight will be assigned to the points 
close or far away from Uj{ti), respectively, see Table | and FIG. 0. Obviously, the distribution 
of the weights has a Gaussian shape when S is sufficiently large. 

A simple moving average filter can be constructed by convolving the mask (|, |) with 
itself 2*5 times, when S = 1, such a filter is the Hanning filter |jl3| (^, |, ^). In our case. 



if we set R = J in the Eq. (|^), the present controlled coupling process has identical filter 
coefficients as those of the Hanning filter. Thus, the proposed controlled coupling process 
filter can be viewed as a generalization of the Hanning filter. A similar analysis including a 
non- vanishing T can be carried out. 

In the rest of this Letter, we demonstrate the utility of the proposed approach through 
numerical experiments. First, we consider the signal extraction from noisy data by the 
controlled coupling process (^. The underlying nonlinear dynamic system is chosen as the 
nonlinear Schrodinger equation 



with periodic boundary conditions ^{x + L,t) = ^{x,t) and the period L = 2^/2,71. This 
system is computationally difficult due to possible numerically induced chaos fl^. In this 
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study, Eq. (^) is allowed to evolves freely with the initial condition of the form \&(x,0) = 
0.5 + 0.05 cos (^x) + ilO~^ sin (^x). At t = ti = 8.0, the system is perturbed and its 
solution is contaminated by the Gaussian white noise to a signal-to-noise ratio (SNR) of 
39.25 dB, see FIG. ^. The controlled coupling process is used to restore the solution from 
noisy dynamical data U (ti) during the time period ti < t < t2. The parameters (i?, T, S) are 
chosen as (0.25, —0.05, 10). From FIG. ^, it is clear that the unwanted noise is satisfactorily 
suppressed by the proposed process. The restored solution matches well with the noise-free 
solution and its SNR is as high as 50.63 dB. 

We next consider the trend estimation of a benchmark time series, the 'Sales of Company 
X' series [|15|,|12|. Such a time series can be regarded as U{ti), produced by an unknown and 
unpredictable dynamic system, and its analysis is of practical importance. The Sales is a 
monthly series ranging from January 1965 to May 1971 and has a monotonic growing trend 
and a clearly identifiable seasonal component. Guided by the earlier stability analysis, we 
choose three sets of T) values, (0.4,0), (0,-0.12), and (0.25,-0.05), for which nearly 
optimal results are obtained at S* = 38, 700 and 52, respectively, see FIG. ^. The Neumann 
boundary condition is used to in this case. As shown in FIG. ^, trends estimated by using 
three sets of parameters are almost identical and provide similar long-run tendency. An 
important feature is that, the slope of the trend undergoes a clear change around the 28th 
month, which agrees with the finding in Ref. |]12| . 



In conclusion, we introduce a controlled coupling process for the synchronization of spa- 
tiotemporal systems. The proposed process isolates the conventional coupling from the 
dynamical system and provides an in-depth analysis of the coupling effect. Numerical sta- 
bility of the proposed process is analyzed. In the context of trend estimation, a comparison 



is given to several standard nonparametric methods ||TO|-p!^], which globally minimization 
the smoothness and fidelity. The proposed process is shown to balance these features in each 
step of time evolution, without resorting to the minimization process, and thus, is numeri- 
cally simpler than the existing methods. In the context of signal processing, a digital filter 
expression of the controlled coupling process is derived and the connection of the proposed 



approach to the standard Harming filter [|T3| is made. The proposed process is apphed to 
signal restoration and trend estimation. 

In the numerical experiment of signal restoration, the solution of the nonlinear 
Schrodinger equation is contaminated by noise at the end of the first time period ti. The 
controlled coupling process is utilized to restore the waveform. We show that the unwanted 
noise can be effectively removed by 10 iterations. In the other experiment, a real-world 
time series generated by some unknown dynamical process is studied. The objective is to 
estimate the trend of the time series. Excellent trend estimations are obtained by using 
three different sets of parameters. The numerical results are in good agreement with those 



in the literature |]T2[ and the present approach is simpler. Obviously, the proposed approach 
can be easily generalized to two spatial dimensions for image processing and the present 
investigation opens up a new opportunity to develop other synchronization-based, realistic 
information process methods. 

This work was supported in part by the National University of Singapore and in part by 
the Center for Dynamic Systems and Nonlinear Sciences. 
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TABLES 



TABLE I. The filter weights 6)] of the controlled coupling process (T = 0). 



k 




i? = 0.4 


R = 0.1 





924i?^ - 1512i?^ + 1050i?^ - AOOR^ + 90i?^ - 12i? + 1 


0.181824 


390804 


1 


~792R^ + 1260i?5 - 840i?^ + 300R^ - GOR"^ + 6R 


0.154368 


0.227808 


2 


495i?6 - 720R^ + 420i?^ - 120i2^ + ISi?^ 


0.12672 


0.065295 


3 


-220i?6 + 270i?5 - 120i?^ + 20i?3 


0.07168 


0.01048 


4 


66i?6 - eOii^ + 15i?^ 


0.039936 


0.000966 


5 


-12R^ + 


0.012288 


0.000048 


6 


i?6 


0.004096 


0.000001 
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FIG. 1. The control functions. 
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FIG. 2. The filter weights of the controlled coupling process (T = 0). 
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FIG. 3. Signal restoration from the contaminated solution of the nonlinear Schrodinger equa- 
tion. Upper: the contaminated solution U{ti); Lower: the restored solution (the dashed line) and 
the noise-free solution (the solid line). 
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FIG. 4. Trend estimation by using the controlled coupling process. 
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